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CHAPTER  1 


INTRODUCTION 


Problem  Statement 

When  new  equipment  is  designed  and  built,  it  may  not 
have  the  reliability  required  to  meet  the  needs  o-f  the  Air 
Force.  Some  o-f  the  reasons  -for  the  deficiencies  are  bad 
design,  poor  part  and  material  selection,  and  poor  work¬ 
manship  in  assembling  the  equipment.  Nearly  all  equipment 
could  be  improved.  Reliability  growth  is  the  improvement  in 
the  reliability  of  a  piece  of  equipment  resulting  from 
correcting  defects  found  in  the  equipment. 

In  the  Aeronautical  Systems  Division  of  the  Air 
Force  Systems  Command,  reliability  growth  is  the  respon¬ 
sibility  of  the  managers  and  engineers  of  the  system  program 
office  (SPO)  working  on  the  equipment.  Unfortunately,  many 
of  these  people  do  not  have  experience  with  reliability  im¬ 
provement.  They  are  not  sure  of  the  best  way  to  improve  the 
equipment.  Reviewing  previous  programs  would  help  these  new 
engineers  and  managers  gain  knowledge  in  this  area.  The  les 
sons  of  existing  programs  could  be  made  available  to  the  new 
people,  helping  them  achieve  their  program  requi rements. 

5®ckgrgund 

Experience  has  shown  that 
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initial  prototype  models  o-f  complex  weapon  systems 
will  invariably  have  inherent  reliability  and  perform¬ 
ance  deficiencies  that  generally  could  not  have  been 
foreseen  and  eliminated  in  early  design  stages  (DOD 
3235. 1-H,  1982,  p.  9-1 >. 

This  is  due  to  “initial  design  and  engineering 
mistakes  as  well  as  manuf acturing  flaws"  built  into  the 
equipment  (Illinois  Institute  of  Technology,  1976,  p.  12). 
If  the  deficiencies  are  corrected  the  weapon  system  will 
become  more  reliable. 

Reliability  improvements  can  occur  anytime  over  the 
life  of  the  equipment.  Ideally,  the  design  phase  is  the 
best  time  to  make  changes,  since  the  equipment  has  not  been 
built.  Then,  changes  in  the  equipment  design  usually 
requires  changes  only  to  plans  and  drawings.  At  that  time, 
expensive  hardware  does  not  need  to  be  modified  or 
scrapped.  Therefore,  the  Air  Force  and  contractors  are 
attempting  to  get  designers  to  refine  the  design  before  the 
first  equipment  is  made.  Yet,  despite  the  best  efforts  of 
designers,  the  initial  reliability  of  the  equipment  often 
still  does  not  meet  the  requirements  and  must  be  further 
improved. 

Correction  of  the  deficiencies  can  take  two  general 
forms.  The  first  is  the  replacement  of  failed  parts  by 
working  parts  of  the  same  type.  In  essence,  the  operation 
of  the  equipment  screens  the  parts  for  weaknesses  and  the 
weak  parts  are  replaced.  The  screened  equipment  does  show  a 
higher  reliability.  However,  if  an  error  in  the  design  of 


the  equipment  causes  the  -first  part  to  fail,  the  new  part 

may  fail  for  the  same  reason  as  the  old  part  and  no  change 

in  reliability  will  occur.  Certainly  this  kind  of 
# 

corrective  action  will  only  effect  the  single  piece  of 
equipment  being  worked  on.  Also,  this  kind  of  correction 
cannot  transfer  improvements  to  other  units  of  equipment 
since  there  is  no  attempt  to  remove  the  failure  mechanisms 
(reasons  for  failure)  and  the  same  failure  could  occur  again 
(Swett,  1979). 

The  second  form  of  reliability  improvement  occurs 
when  a  failure  is  examined  and  the  failure  mechanism  is 
identified.  The  failure  could  be  due  to  the  design, 
workmanship,  or  software.  If  it  is  a  design  problem,  the 
design  of  the  part  or  equipment  is  reviewed  to  see  if  the 
conditions  that  allowed  the  part  to  fail  can  be  removed.  If 
feasible,  the  design  is  changed  to  permanently  remove  the 
failure  mechanism. 

If  the  failure  is  caused  by  poor  workmanship,  the 
production  process  is  reviewed  and  the  necessary  changes  are 
made  to  keep  the  failure  from  recurring.  For  example,  the 
correction  could  be  to  add  a  cleaning  step  before  conformal 
coating  a  printed  circuit  board.  All  future  equipment 
manufactured  using  the  new  process  will  benefit  from  the 
changes. 

If  the  failure  is  software  related,  the  programs  for 
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the  equipment  are  reviewed  and  debugged.  While  all  possible 
errors  are  not  likely  to  be  found  (the  possible  combinations 
of  even  a  short  program  are  very  large),  the  error  causing 
the  particular  failure  can  be  removed. 

Thus,  the  incorporated  design,  workmanship,  or 
software  change  results  in  the  reliability  improvement  in 
the  equipment.  As  noted  above,  the  improvements  are 
permanent  and  they  can  be  transferred  to  any  new  or  modified 
piece  of  equipment.  This  improvement  is  called  reliability 
growth. 

Traditionally,  reliability  growth  has  been  just 
identified  with  equipment  hardware.  For  example,  RADC’s 
Reliability  Design  Handbook  states: 

Reliability  growth  represents  the  resultant  action  to 
hasten  a  hardware  item  towards  its  reliability  poten¬ 
tial  either  during  development  or  during  subsequent 
manufacturing  or  operation  C emphasis  added!  (Illinois 
Institute  of  Technology,  1976,  p.  12). 

However,  with  the  increasing  importance  of  software, 
it  is  worthwhile  extending  the  concept  of  reliability 
improvement  to  software  as  well  as  hardware.  Therefore, 
improvements  in  both  hardware  and  software  result  in 
reliability  growth. 

5®£iDiti°Ds 

Reliability  Growth:  For  the  purposes  of  this  paper, 
reliability  growth  will  be  defined  as  the  positive 
improvement  in  the  reliability  of  equipment  hardware  or 


4 


so-ftware  through  the  systematic  and  permanent  removal  o-f 
failure  mechanisms. 

Reliability:  Reliability  is  the  probability  that  an 
equipment  will  operate  without  failure  for  a  specific  time 
under  stated  conditions  (AFR  800-18,  1982). 

Scope 

This  research  will  examine  the  planned,  proposed, 
and  implemented  reliability  growth  programs  of  five  major 
weapon  systems  in  ASD.  The  weapon  systems  are  the  B-1B, 

B— 52,  F— 15,  F— 16,  and  the  A6M-B6B  Air  Launched  Cruise 
Missile.  Since  reliability  growth  deals  with  the  improvement 
of  existing  equipment,  activities  related  to  designing-in 
initial  relability  and  to  environmental  stress  screening  to 
remove  early  (infant)  failures  in  equipment  will  be 
excluded. 

Research  Objective 

The  purpose  of  this  paper  is  to  describe  the 
reliability  growth  programs  of  various  ASD  system  program 
offices.  The  information  contained  in  this  paper  will  be  of 
interest  to  people  seeking  an  overview  of  the  current 
reliability  growth  programs  for  major  weapon  systems  at  ASD. 
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CHAPTER  2 


RELIABILITY  GROWTH 

Reliability  Growth  Process 

Reliability  growth  is  an  iterative  process  that 
includes  the  -following  steps: 

1.  Detection  o-f  -failure  sources, 

2.  Feedback  o-f  identi-fied  problems, 

3.  Redesign  e-f-fort  based  on  identi-fied  problems, 

4.  Building  o-f  improved  hardware  or  software,  and 

5.  Verification  of  improvements  due  to  the  redesign 
(DOD  MIL— HNBK— 189,  1981). 

The  rate  at  which  reliability  grows  is  dependent  on 
how  rapidly  the  above  process  is  accomplished,  the  magnitude 
of  the  problems  identified,  and  how  effective  the  corrective 
actions  have  been  in  removing  the  failure  mechanism  without 
introducing  new  problems  (DOD  MIL-HNBK-189,  1981). 
Improvement  cannot  occur  at  a  faster  rate  than  the  com¬ 
pletion  of  all  the  steps  in  the  process  allows.  For 
example,  if  many  hardware  failures  were  detected  during 
testing  and  the  necessary  redesign  accomplished,  no  growth 
would  be  seen  until  the  changes  were  incorporated  in  new  or 
modified  hardware.  "Any  of  these  [above!  activities  may  act 
as  a  bottleneck.  The  cause  and  degree  of  the  bottleneck  may 
vary  from  one  development  program  to  the  next"  (DOD 
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MIL— HNBK— 189,  1981,  p.  6) 


Reliability  Growth  Curves 

For  a  system  under  development,  the  reliability 
usually  starts  increasing  rapidly  (as  the  obvious  or 
easy-to— fix  corrections  are  made)  and  then  slows  as  the 
improvements  become  more  difficult  to  implement.  In  its 
idealized  form,  this  forms  a  smoothly  rising  curve  (Figure 
1)  . 
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Figure  1 

Idealized  Growth  Curve 


The  reliability  does  not  actually  grow  in  such  a  smooth 
fashion.  Since  improvements  to  hardware  rarely  occur 
uniformly,  the  curve  will  not  be  smooth.  Often,  the  time 
between  detecting  a  failure  and  modifying  the  hardware 


causes  delayed  growth.  At  times,  corrections  will  be  added 
to  equipment  in  batches  causing  the  reliability  to  jump 
upward.  The  reliability  growth  is  then  seen  as  a  series  of 
rising  curves  with  a  separate  curve  for -each  phase  (Figure 
2). 
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Figure  2 

Phased  Growth  Curve 


Even  though  the  idealized  curve  is  not  accurate  at 
all  times  during  the  program,  it  is  very  useful  in  quan¬ 
tifying  the  overall  development  effort  and  is  a  significant 
tool  in  the  planning  or  monitoring  of  reliability  growth 
(DOD  3235.1 -H,  1982). 

In  1962,  J.T.  Duane  reported  that  cumulative 
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reliability  growth  curves  approximated  straight  lines  when 
plotted  on  log-log  graph  paper.  Since  then,  log-log 
plotting  of  cumulative  reliability  has  been  used  as  an  easy 
method  of  depicting  reliability  growth. 

Three  ideal  growth  curves  are  plotted  on  log-log 
scales  in  Figure, 3.  All  the  lines  start  at  the  same  point, 
but  have  different  slopes.  Since  the  slope  of  the  line  is 
proportional  to  the  rapidity  of  improvements  made  on  the 
observed  equipment,  the  slope  can  be  used  to  quantify  the 
intensity  of  a  growth  program:  a  0. 1  slope  represents  a  low 
intensity  program  while  a  0.6  slope  depicts  a  very  intense 
program,  with  0.3  as  average. 
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Log-Log  Growth  Curve 
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According  to  Codier  <1968,  p.  460) 


Where  a  systematic  and  deliberate  reliability  improve¬ 
ment  effort  is  being  made,  Cthe  slope!  is  usually  found 
to  be  in  the  range  0.3  to  0.5.  The  value  is  ...  . 
higher  in  proportion  to  the  ...  reliability  improvement 
effort. 

Reliability  growth  curves  have  several  potential 
purposes.  According  to  Anderson  (1976,  p.  27),  they 
include: 

1.  Monitoring  the  reliability  progress  of  the  sys¬ 
tem  as  it  proceeds  through  development. 

2.  Providing  for  the  forecasting  of  short-term 
rel i abi 1 i ty. 

3.  Providing  the  means  to  measure  the  effectiveness 
of  design  changes. 

4.  Planning  the  development  program  and  controlling 
its  progress  as  the  design  matures. 

All  these  can  be  used  in  managing  the  growth  program. 
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Reliability  Growth  Management 

Reliability  growth  management  is  the  systematic 
planning  for  reliability  achievement,  and  then  controlling 
the  rate  of  achievement  by  reallocating  resources  based  on 
comparisons  between  planned  and  assessed  reliability  values 
(DOD  MIL-HDBK— 189,  1981). 

Normally,  the  goal  of  a  reliability  program  is  to 
achieve  the  reliability  and  performance  requirements.  If 
the  requirements  are  met  by  the  initial  equipment,  no  growth 
program  is  needed.  But,  as  stated  earlier,  many  systems  do 
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not  meet  the  reliability  requirements  by  the  end  o-f  their 
development  programs.  Sometimes  the  manager  o-f  a  program 
has  not  been  aware  that  the  reliability  requirements  o-f  the 
equipment  were  not  being  achieved  until  the  end  o-f  the 
program  when  a  final  demonstration  of  the  equipment  was  made 
and  the  reliability  was  lower  than  expected.  Additional 
resources  and  time  had  to  be  allocated  before  the 
requirements  were  met. 

Early  emphasis  on  reliability  performance  can 
substantially  increase  the  chance  of  meeting  the 
objectives.  Using  reliability  growth  curves,  the  manager 
can  assess  the  equipment's  progress  toward  the  reliability 
goals. 


Department  of  Defense  Directive  (DODD)  5000.40 
establishes  policies  and  responsibilities  for  reliability 
and  maintainabi 1 ity  (R&M) .  In  part,  the  reliability  growth 
policy  is: 

RW1  growth  is  required  during  full  scale  develop¬ 
ment  concurrent  development  and  production  ...  and 
during  initial  deployment.  Predicted  R&M  growth  shall 
be  stated  as  a  series  of  intermediate  milestones,  with 
associated  goals  and  thresholds,  for  each  of  these 
phases  (DODD  5000.40,  1980,  p.  4). 

A  proposed  handbook  on  reliability  (D0D 
MIL— HDBK— XXX,  1982,  p.  8-71)  states: 

Reliability  growth  planning  addresses  program  sched¬ 
ules,  amount  of  testing,  resources  available  and  the 
realism  of  the  test  program  in  achieving  the  require¬ 
ments  .  .  .  .  It  is,  therefore,  essential  that  periodic 
assessments  of  the  reliability  be  made  during  the  test 
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program  .  .  .  and  compared  to  the  planned  reliability 
growth  values.  By  making  appropriate  decisions  in 
regard  to  the  timely  incorporation  of  effective  -fixes 
into  the  system  commensurate  with  attaining  the  mile¬ 
stones  and  requirements,  management  can  control  the 
growth  process. 

According  to  DQD  MIL-HDBK-1B9  (1981),  there  are  two 
ways  that  the  manager  evaluates  the  reliability  growth 
process.  The  -first  is  by  assessing  the  quantitative 
reliability  o-f  the  equipment  throughout  the  program.  The 
second  is  by  a  qualitative  monitoring  of  the  steps  in  the 
process  to  assure  that  they  are  accomplished  in  a  timely 
manner  and  that  the  effort  and  quality  of  work  comply  with 
the  program  plan. 

The  assessment  approach  requires  at  least  one 
quantitative  evaluation  of  the  equipment's  reliability  to 
match  against  the  proposed  growth  curve.  This  is  only 
possible  after  equipment  has  been  built,  and  sufficient 
operation  has  taken  place  to  develop  a  reliability  value. 

The  assessment  approach  is  results  oriented; 
however,  the  monitoring  approach,  which  is  activities 
oriented,  is  used  to  supplement  the  assessments  and  may 
have  to  be  relied  on  entirely  early  in  a  program.  This 
is  often  necessary  because  of  the  lack  of  sufficient 
objective  information  in  the  early  program  stages 
(DQD  MIL— HDBK— 189,  1981,  p.  8) . 

It  is  important  to  remember  that  reliability  growth 
management  techniques  do  not,  in  themselves,  manage.  "They 
simply  make  reliability  a  more  visible  and  manageable 
characteri Stic"  (DQD  MIL-HNBK-189,  1981,  p.5). 


12 


Reliability  Growth  Programs 

For  the  purposes  of  this  paper,  a  reliability  growth 
program  is  defined  as  any  established  program  which  results 
in  the  improvement  of  reliability  through  the  -five  step 
process  o-f : 

1.  Detection  o-f  failure  sources, 

2.  Feedback  of  identified  problems, 

3.  Redesign  effort  based  on  identified  problems, 

4.  Building  of  improved  hardware  or  software,  and 

5.  Verification  of  improvements  due  to  the  redesign. 
Since  reliability  growth  can  occur  in  hardware  or 

software  and  results  from  correcting  faults  caused  by  design 
or  workmanship,  it  follows  that  there  may  be  no  "one  best 
way"  to  achieve  the  improvement.  Any  approach  that  follows 
the  five  step  process  should  result  in  reliability  growth. 

The  detection  of  failure  sources  usually  occurs 
during  the  operation  of  the  equipment.  Since  any  operation 
can  result  in  a  failure,  the  detection  of  a  failure  can 
occur  during  both  a  formal  testing  program  (with  the 
failures  reported  in  a  test  report)  or  during  operation  in 
the  field  (with  failures  reported  by  deficiency  reports) . 

The  advantage  of  a  formal  testing  program  is  that  it  results 
in  many  hours  of  operation  under  the  close  control  of  the 
testing  agency. 
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The  redesign  of  the  hardware  or  software  does  not 
occur  unless  the  program  office  and  the  contractor  consider 
reliability  growth  necessary  and  allocate  the  time  and  funds 
to  achieve  it. 

Testing  Cby  itself]  does  not  improve  reliability. 
Only  corrective  actions  that  prevent  the  recurrence 
of  failures  in  the  operational  inventory  actually 
improve  reliability  (DOD  MIL-STD-785B,  1980,  p.  A-28) . 

The  following  chapters  will  present  the  current 
reliability  growth  programs  of  five  major  weapon  systems 
under  devlopment  at  ASD.  The  programs  are  the  B— 52  Offensive 
Avionics  System,  B-1B,  F-15,  F-16,  and  AGM-86B  Air  Launched 
Cruise  Missile.  Also  presented  will  be  a  chapter  describing 
the  Component  Improvement  Programs  for  the  engines  used  on 
the  F-15,  F-16,  and  the  B-1B. 
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CHAPTER  3 


B— 52  OFFENSIVE  AVIONICS  SYSTEM 


§^£]<9CQyQd 

The  B-52  Offensive  Avionics  System  <OAS>  will 
replace  a 

relatively  low-reliability  analog  bombing  and  navi¬ 
gation  system  on  B-52  G  and  H  aircraft  with  high  relia¬ 
bility  solid-state  digital  equipment  of  greater  accuracy 
and  smaller  size'1  (TASC,  1983,  p.  1-1). 

The  OAS  consists  of  34  line  replaceable  units  (LRUs)  re¬ 
placing  104  existing  LRUs  on  each  aircraft.  The  Strategic 
Air  Command  desired  the  update  to  "improve  the  system  relia¬ 
bility  and  maintainability  and  tD  increase  the  navigation 
and  bombing  accuracies  of  the  B-52  S&H"  (ASD,  1978,  p.  1). 

The  Strategic  Systems  System  Program  Office  (SSSPO) 
of  ASD  is  the  directorate  responsible  for  the  development  of 
the  B-52  OAS.  Development  of  the  system  started  in  1978. 

The  prime  contractor  for  the  OAS  is  the  Boeing 
Military  Airplane  Company  (BMAC)  who  is  responsible  for 
installing  the  equipment  in  the  aircraft  and  who  also 
manufactures  eight  of  the  LRUs.  There  are  six  subcontractors 
who  manufacture  the  rest  of  the  OAS  equipment. 

Jest  Jl._Anal_yzeJ._and_Fi.x_2est 

A  subsystem  Test,  Analyze,  and  Fix  (TAF)  test  was 
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conducted  on  selected  OAS  equipment  by  BMAC,  and  the 
subcontractors:  Honeywell,  IBM,  Lear  Seigler,  Norden, 

Sperry,  and  Sundstrand.  The  test  consisted  of  subjecting  the 
equipment  to  a  series  o-f  simultaneous  vibration  and  rapid 
temperature  cycles:  conditions  designed  to  accelerate 
failure  rates.  The  test  articles  were  operated  and 
monitored  for  failure  during  the  test  using  special  test 
equipment.  All  failures  were  analyzed  and  corrective 
actions  were  formulated.  The  test  was  conducted  in  phases 
from  July  1981  through  October  1982  at  the  contractors'  test 
facilities  and  cost  approximately  *15  million. 

The  goal  of  TAF  is  the  achievement  of  high  relia¬ 
bility  prior  to  the  early  delivery  phase  of  production 
equipment.  Enhancing  reliability  at  this  time  is  much 
less  expensive  than  implementing  reliability  improvements 
by  retrofit  in  fielded  equipments  (TASC,  1983,  p.  1-2). 

After  identifying  failure  modes,  the  program  office 
was  to  select  certain  corrective  actions  for  implementation 
using  cost/benefit  analyses.  The  analyses  took  into  account 
increased  life-cycle  costs  and  operational  impacts  if  the 
corrections  were  not  made.  The  contractors  were  not 
required  to  implement  any  corrective  actions  on  their  own, 
though  some  did  so  (at  no  cost  to  the  Air  Force). 

The  program  office  decided  to  forego  any  Reliability 
Improvement  Warranty  or  Guaranteed  MTBF  (Mean  Time  Between 
Failure):  proceeding  with  the  TAF  test  instead.  BMAC  would 
have  charged  over  *21  million  in  advance  to  allow  for  cor- 
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recting  possible  deficiencies  under  such  a  warranty  or  guar — 
antee  <  ASD,  1978).  The  program  office  believed  it  could 
conduct  a  TAF  test,  identify  any  important  reliability 
problems,  and  pay  for  the  specific  fixes  while  spending  less 
than  *21  million.  In  short,  the  reasoning  was  that  the  TAF 
test  would  save  money. 

Egui.E>ment_Jested 

Table  1  lists  the  equipment  tested  and  the  organ¬ 
ization  responsible  for  the  testing. 

Significant  Test  Requirements 

Prior  to  starting  the  TAF  test,  the  units  must  have 
passed  their  respective  acceptance  tests  and  been  accepted 
by  the  Air  Force  or  by  the  prime  contractor. 

During  the  test,  each  LRU  type  was  to  accumulate  a 
total  of  2400  hours  of  equipment  operating  time.  Exception: 
IBM  was  to  accumulate  600  cycles  on  the  ACU  regardless  of 
the  number  of  hours.  To  proportion  the  time  between  the 
test  articles,  each  piece  of  equipment  was  to  operate  at 
least  one  half  the  average  operating  time  of  like  equipment 
under  test . 

The  test  length  (2400  total  hours)  was  chosen  to 
allow  the  completion  of  the  test  in  time  to  incorporate  the 
corrective  actions  in  most  of  the  production  equipment. 

Unf ortunatel y,  due  to  delays,  the  first  three  lots  of  pro- 
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TEST 

ORGANIZATION 

BMAC 


Honeywel 1  — 
Minneapol is 


IBM 


Lear — 
Seigler 


Norden 


Sperry 

Flight 

Systems 


Sundstrand 


NUMBER 


DESCRIPTION  TESTED 

Armament  Inter-face  Unit  2 

Radar  Inter-face  Unit  2 

Electronics  Inter-face  Unit  2 

Controls/Displays  Interface  Unit  2 

Decoder  Recei ver  4 

Weapon  Control  Panel  2 

Radar  Set  Control  2 

Computer  Subsystem  Control  Panel  2 

Electronic  Altimeter  Set,  AN/APN-224 

Receiver  -  Transmitter  2 

Height  Indicator  2 

Avionics  Control  Unit,  APY-10  (ACU)  4 

Attitude-Heading  Gyroscope  Set,  AN/ASN-134 
Displacement  Gyroscope  2 

Electronic  Control  Amplifier  2 

Radar  Set  Group  OY-731  ASQ-176 

Receiver  Transmitter — Modulator  2 

Ferrite  Switch  2 


Control  Display  Set  AN/ASQ-175 

Signal  Data  Converter  2 
Video-Recorder  2 
Digital  Computer  2 
Multifuction  Display  Indicator  4 
Integrated  Keyboard  4 

Data  Transfer  Set,  AN/ASD-7 

Transmitter  Control  2 
Magnetic  Tape  Transport  4 
Electrical  Equipment  Mounting  Base  2 


Table  1 

Equipment  Tested 

(BMAC,  1982) 
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duction  were  completed  prior  to  incorporating  most  o-f  the 
corrective  actions. 

Test  Results 

Table  2  shows- the  results  o-f  the  test.  The  low 

number  o-f  -failures  for  Honeywell,  IBM,  and  Lear  Siegler  can 

« 

be  attributed  to  mature  equipment  design.  All  three 
contractors  have  manufactured  similar  equipment  before 
(TASC,  1983) . 


TOTAL 

RELEVANT 

INCORPORATED 

RECOMMENDED 

ORGANIZATION 

FAILURES 

FAILURES 

FIXES 

FOR  INC0RP 

BMAC 

129 

100 

63 

10 

Honeywel 1 

11 

4 

4 

0 

IBM 

19 

12 

1 

O 

Lear  Seigler 

12 

10 

3 

O 

Norden 

50 

41 

7 

11 

Sperry 

lOO 

91 

46 

9 

Sundstrand 

165 

141 

53 

17 

Table  2 

Test  Results 

(BMAC,  1982;  TASC,  1983) 

From  the  299  relevant  failures,  over  105  corrective  actions 
were  incorporated  into  the  production  design  prior  to  the 
end  of  the  test  at  no  cost  to  the  government.  The 
in— production  changes  were  of  three  basic  types:  process, 
part,  and  quality  control. 
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Process  changes  involve  a  revision  of  the  manufac¬ 
turing  steps  in  order  to  eliminate  a  failure  mechanism. 
Part  changes  include  the  replacement  of  parts  with  more 
reliable  and/or  better  performing  componets  or  the  use  of 
screening  to  eliminate  degraded  parts.  Quality  Control 
<QC)  changes  involve  increased  survei  Hence  of  workman¬ 
ship  problems  or  revisions  to  the  quality  inspection  pro¬ 
cedures.  (TASC,  1983,  p.  2-3  > 

Some  design  change  failures  were  also  incorporated 
in  production.  “Design  changes  are  those  that  require  a 
change  to  existing  parts,  drawings  or  documentation  which 
carry  a  cost  associated  for  the  change"  (TASC,  1983).  Where 
the  design  change  was  already  approved,  the  change  was 
included  with  the  "incorporated  in  production"  failures. 

An  additional  26  corrective  actions  were  recommended 
to  the  program  office  for  incorporati on.  These  failures  all 
required  design  changes  which  meant  getting  SPO  approval. 

Each  failure  which  resulted  in  a  corrective  action 
or  proposed  corrective  action  was  analyzed  to  determine  its 
effect  on  mission  success.  Eight  failures  were  found  to 
cause  a  mission  failure  by  inhibiting  the  release  of 
weapons,  31  had  no  effect,  and  the  rest  caused  a  partial 
degradation  of  mission  success  probability  (from  1  to  12 
1/2%) . 

Potential._Cgst_Sayings 

In  addition  to  the  improved  mission  reliability, 
there  is  the  possibility  of  logistics  support  cost  savings 
when  the  necessary  corrective  actions  are  taken. 

Since  logistics  support  costs  are  particularly  sen- 


sitive  to  -fluctuations  in  Mean  Time  Between  Failure 
(MTBF),  the  cost  savings  which  can  be  realized  by  con¬ 
trolling  this  -factor  are  quite  significant  (BMAC,  1982, 
p. 32) . 

The  composite  MTBF  for  all  the  units  under  test  was 
calculated  by  BMAC  to  be  13  hours.  If  all  the  possible 
corrective  actions  were  successful,  the  MTBF  would  rise  to 
65  hours:  a  theoretical  increase  of  400%  (BMAC,  1982). 

The  Analytic  Sciences  Corporation  (TASC) ,  under 
contract  to  the  SSSPO,  calculated  an  82%  improvement  in  MTBF 
using  field  data  for  Mean  Flying  Hours  Between  Maintenance 
(TASC,  1983).  Again,  this  is  a  theoretical  calculation. 

Using  the  Air  Logistics  Center  logistics  support 
cost  model,  BMAC  calculated  a  15  year  cost  savings  of 
*224,360,000  if  all  the  corrective  actions  were  incorporated 
and  the  reasons  for  failure  were  removed.  Initial  spares 
were  included  in  this  estimate. 

If  the  TAF  recommended  changes  were  not  incorporated, 
the  above  costs  would  be  incurred  over  the  next  15  years 
in  additional  support  costs  (spares,  maintenance,  support 
equipment,  training  requirements,  and  management 
(BMAC,  1982) . 

The  savings  of  *224  million  is  optimistic.  It 
assumes  the  effective  implementation  of  all  the  recommended 
corrective  actions  and  the  reduction  in  the  number  of  spares 
required  due  to  higher  MTBFs. 

TASC  estimates  the  savings  to  be  *37  million.  The 
initial  spares  are  excluded  from  their  calculations  because 
those  units  have  already  been  purchased.  Also  not  all  the 
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recommended  corrective  actions  will  be  incorporated  by  the 
Air  Force.  Therefore  the  savings  are  expected  to  be  lower 
than  the  BMAC  estimate  <TASC,  1983). 

With  either  estimate,  the  theoretical  savings  are 
greater  than  the  cost  o-f  the  test.  Adding  the  savings  -from 
not  paying  -for  a  RIW  and  MTBF  guarantee,  the  TAF  test  saved 
at  least  *43  million  in  li-fe  cycle  costs. 

(Jn-fortunately  there  is  no  easy  way  to  assess  how 
many  o-f  the  proposed  corrective  actions  really  work.  There 
are  no  planned  verification  o-f  the  corrections.  Also,  there 
are  no  tests  that  can  be  used  -for  a  before  vs.  after 
comparison.  Therefore  the  theoretical  costs  will  probably 
never  be  confirmed. 
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Chapter  4 


B-'IB 

Background 

The  B-1B  aircraft  is  the  Air  Force’s  new  strategic 
bomber  to  replace  the  aging  B-52.  Outwardly,  the  aircraft 
closely  follows  the  design  of  the  original  B-l  that  was 
cancelled  in  1977.  Internally,  several  changes  were  made, 
including  updating  the  electronics  to  meet  the  threats  of 
the  1980s  (Slenski,  1983). 

The  B-1B  SPO  at  ASD  is  responsible  for  the 
development  of  the  B-1B  aircraft  and  its  support  equipment. 
The  SPO  is  acting  as  the  prime  integrator  for  the  following 
associate  contractors:  Rockwell  -  Air  Vehicle,  Boeing 
Military  Airplane  Company  <BMAC) -Seattl e  -  Offensive 
Avionics,  and  Eaton  Industri es-AIL  Division  (AIL)  - 
Defensive  Avionics.  The  Propulsion  SPO  is  responsible  for 
the  development  of  the  aircraft’s  General  Electric  engines 
(see  the  F101  Engine  Component  Improvement  Program) . 

Beliability_Growth_Management 

In  1982,  the  Strategic  Air  Command  (SAC)  stated  a 
need  for  the  B-1B  to  have  an  inherent  mean-ti me-between- 
maintenance  (MTBMi)  of  1.0  hours  with  a  MTBMi  goal  of  2.0 
hours.  SAC  also  asked  for  a  mission  completion  success 
probability  (MCSP)  of  0.92  for  a  hypothetical  model  mission 
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(Slenski,  1983). 


IfCSP  is  defined  as  the  probability  that  the  aircraft 
shall  complete  the  scheduled  mission  without  experiencing 
an  on-equipment  failure  or  performance  degradation  which 
would  result  in  an  abort,  or  mission  deviation  which 
would  preclude  the  accomplishment  of  the  scheduled  mis¬ 
sion  <ASD,  1981a). 

The  B— IB  Test  and  Evaluation  Master  Plan  (TEMP)  has 

« 

established  the  following  thresholds  and  goals  for  MTBMi  and 


MCSP  at  Initial  Operational  Capability  (IOC)  and  maturity 
(200,000  flight  hours): 


IOC 

Thres 


MTBMi  (hours)  .25-. 28 

MCSP  . 78 


MATURITY 
Thres  Goal 


1.0  2.0 
0.92 


In  order  to  meet  the  above  reliability  requirements 
and  to  provide  for  the  tracking  of  reliability  improvements, 
the  SPQ  has  established  reliability  growth  curves  for  each 
of  the  associate  contractors.  The  curves  are  shown  in 
Figures  4,  5,  and  6. 

The  curves  are  plotted  against  log-log  scales  and 
are  shown  as  straight  lines.  Each  curve  starts  with  a  0.3 
slope  and  then  changes  to  a  0.1  slope  at  IOC  ♦  2  years 
(estimated  to  be  50,000  flight  hours).  The  curves  continue 
up  to  maturity  at  200,000  flight  hours. 


Testx_AnalyzeA_and_Fix_Test 

A  Test,  Analyze,  and  Fix  (TAF)  test  is  planned  for 
the  avionics  procured  from  Rockwell,  AIL,  and  BMAC.  The  B-1B 
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SPO  believes  the  TAF  test  is  needed  to  achieve  the  required 
reliability  and  is  not  intended  to  correct  known  reliability 
problems  (Slenski,  1983). 

The  test  will  consist  of  rapid  temperature  cycling 
with  simultaneous  random  vibration.  The  performance  of  the 
equipment  will  be  checked  at  intervals  during  the  test.  The 
test,  starting  in  1984,  will  accrue  1000-2000  total  hours  of 
operation  for  each  equipment  type.  Rockwell  will  test  at 
least  two  of  each  type  of  equipment  (each  equipment  under 
test  will  accumulate  at  least  500  hours  of  test  time).  BMAC 
will  test  two  of  each  type  of  equipment  (with  a  250  hour 
minimum)  and  AIL  will  test  at  least  one  of  each  type 
(Slenski.  1983). 


The  test  lengths  were  chosen  as  a  compromise  of 
three  things:  the  need  to  obtain  growth,  have  failure 
ver i f i cati on ,  and  be  affordable.  The  tests  had  to  be  long 
enough  that  some  correctable  failures  are  likely  to  be 
found.  Then,  additional  test  time  was  desired  to  verify 
that  the  implemented  corrective  action  worked  as  intended. 
Finally,  since  the  entire  test  had  to  be  affordable,  the 
proposed  tests  were  held  to  2000  hours  or  less  for  each 
equipment  type. 

Any  failures  during  the  test  will  be  analyzed  down 
to  the  piece  part  level  by  the  contractor,  the  failure 
mechanism  will  be  identified,  and  a  corrective  action 
recommended.  As  in  the  OAS  TAF  test,  the  contractors  are 
not  required  to  incorporate  any  corrective  actions  by 
themselves.  As  in  the  OAS  TAF  test,  the  contractors  may 
incorporate  corrective  actions  at  no  cost  to  the 
government.  The  B-1B  SPO  will  review  the  recommended 
corrective  actions  and  then  implement  and  fund  corrections 
using  ECPs. 

There  are  no  direct  costs  or  savings  identified  for 
this  program.  The  TAF  test  is  included  under  the  broad  Work 
Breakdown  Structure  of  "Rel i abi 1 i t v  ’  and  is  not  priced 
separately.  Therefore  the  actual  c~  t  (after  contract 
negotiations)  is  unavailable. 

Because  the  TAF  test  is  early  in  the  program,  there 
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can  be  no  actual  before/after  comparisons  of  achieved 
reliability.  At  the  conclusion  of  the  test,  a  theoretical 
estimate  of  the  improvements  can  be  made  using  test  data. 

Since  the  B-rlB  TAF  test  was  patterned  after  the  B-52 
OAS  TAF  test,  similar  results  can  be  expected.  The  test 
should  identify  many  failures  that  can  be  corrected  by  the 
contractor  at  no  cost  to  the  government.  A  few  major 
corrections  will  need  additional  funds  to  implement,  but  the 
savings  should  outweigh  the  costs.  The  total  saving 
probably  will  not  be  as  great  as  for  the  B— 52  OAS  because 
there  will  be  fewer  units  produced  (for  100  B-lBs  vs.  over 
200  B— 52s ) . 
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Chapter  5 


F-15  EAGLE 

Background 

« 

The  F-15  Eagle  is  the  USAF’s  primary  air  superiority 
fighter.  Designed  and  built  by  McDonnell  Aircraft  Company, 
the  F— 15  first  flew  in  1972.  By  the  1990s,  the  USAF  intends 
to  buy  over  1,470  of  these  fighters.  A  current  effort  by 
the  Directorate  for  Tactical  Systems  is  to  upgrade  the 
avionics  to  make  the  equipment  more  flexible. 

Mul_ti— Stage_Imgrgyement_Prggram 

The  Multi-Stage  Improvement  Program  (MSIP)  is 
intended  to  update  the  capabilities  of  the  F-15  to  "keep 
place  with  technology"  and  provide  a  "viable  weapon  system 
into  the  1990s"  (Roadruck,  1983).  The  major  improvements 
i nclude: 

Programmable  Armament  Control  System  (PACS) 

Improved  Centra.*  Computer  (CC) 

Improved  air — to-ground  radar 

"Multi-stage"  refers  to  the  phased  schedule  of  incorporating 
the  improvements  into  the  fleet  of  F-15s. 

While  reliability  improvement  is  not  the  main  goal 
of  the  MSIP,  certain  MSIP  equipment  will  undergo  a 
Reliability  Development  Test  <RDT)  which  should  result  in 
reliability  growth.  The  tests  will  be  conducted  at  the 


29 


contractors  plants  using  environmental  chambers.  The  tests 
are  intended  to  identify  high  risk  failure  items  which 


impact  reliability. 

The  reliability  growth  objectives  of  the  RDT  are: 

to  grow  the  reliability  of  the  equipment  by  syste¬ 
matic  identification  and  elimination  of  failure  causes 
by  formulation  of  effective  corrective  action  for 
each  [emphasis  added!  failure  encountered  during 
the  test  (without  regard  to  relevancy  of  failure) 
(Edwards,  1983)  . 

The  following  production  (or  preproducti on)  equipment  will 
undergo  RDTs: 


EQUIPMENT 


CONTRACTOR 


Multipurpose  Color  Display  (MPCD) 
Programmable  Armament  Control  Set  (PACS) 
Central  Computer  (Modified)  (CC) 

Improved  Radar 


Sperry 

Dynamics  Control 
IBM 

Hughes 


Table  3  shows  the  specified  and  predicted  mean  times 


between  failure,  the  number  of  units,  and  the  total 


operating  hours  for  each  type  of  equipment  in  the  test. 


» 


SPECIFIED 

PREDICTED 

TEST 

UNITS  TO 

EQUIPMENT 

MTBF  (hrs) 

MTBF  (hrs) 

HOURS 

BE  teste; 

MPCD 

500 

2500 

5000 

2 

PACS 

400 

395 

4000 

2 

CC 

1200 

1500 

6000 

3 

RADAR 

75 

169 

500 

i 

Table  3 


Reliability  Demonstration  Test  Requirements 

(Harmsworth,  1983) 
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The  tests  are  structured  to  identity  high  risk  -fail¬ 
ure  items  which,  if  uncorrected,  would  cause  the  equip¬ 
ment  to  exhibit  unacceptable  levels  of  reliability  during 
operational  usage  (Tactical  Systems,  undated,  p.  1). 

The  program  office  has  reserved  the  right  to 
terminate  the  test  at  any  time  if  the  objectives  are  not 
being  met  (e.g.  if  there  are  no  failures)  (Harmsworth, 

1983) . 

The  test  lengths  were  proposed  by  the  prime 
contractor,  McDonnel 1-Dougl as.  The  program  office  requested 
a  growth  test  length  at  least  five  times  the  specified  MTBF 
as  recommended  in  MIL— STD— 1635  (EC).  McDonnel 1 -Dougl as 
responded  with  proposed  tests  between  five  to  ten  times  the 
specified  MTBF  as  shown  in  Table  3  (Edwards,  1983). 

Each  test  sample  will  have  completed  burn-in 
(environmental  stress  screening  to  remove  early  failures) 
and  acceptance  testing  before  starting  the  RDT.  Reliability 
qualification  tests  will  take  place  after  the  RDT. 

The  RDTs  will  consist  of  rapid  temperature  cycling 
combined  with  random  vibration  and  induced  humidity.  The 
performance  of  the  equipment  under  test  will  be  measured  on 
a  routine  basis  using  built-in-test  (if  available)  and 
periodic  acceptance  tests. 

If  a  failure  occurs,  the  equipment  will  be  repaired, 
re-pass  an  acceptance  test,  and  be  returned  to  the  RDT. 

While  the  equipment  is  being  repaired,  a  spare 
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shop -rep lac able-  unit  will  be  used  as  a  replacement  to  allow 
the  test  to  continue.  A  -Failure  analysis  will  be  performed 
on  each  failure  and  a  corrective  action'  will  be  formulated. 

Using  theoretical  values  proposed  by  Duane  (1962), 
Harmsworth  <1983)  plotted  growth  curves  for  the  MPCD,  PACS, 
and  CC  (Figures  7,  8,  and  9).  To  achieve  the  required 
reliability  in  the  planned  hours  of  test  operation,  the 
slopes  of  the  improvement  plots  need  to  be  0.3,  0.35,  and 
0.6  respectively. 

While  a  growth  program  requiring  a  improvement  slope 
of  0.6  is  possible,  such  a  program  is  ambitious.  According 
to  Codier  (1968),  the  normal  range  of  expected  slopes  are 
from  0.1  to  0.5.  Normally,  achieving  a  0.6  slope  will 
require  correction  of  every  failure  regardless  of  the  time 
or  money  involved  in  formulating  or  implementing  the 
corrective  action  (General  Electric,  1973).  Resource 
constraints  would  probably  restrict  the  growth  program, 
resulting  in  a  lower  slope. 

Edwards  (1983)  believes  the  actual  MTBF  of  the 
Central  Computer  as  it  enters  the  growth  test  will  be  higher 
than  the  value  predicted  by  Harmsworth  using  Duane’s 
theory.  Edwards  believes  the  computer’s  MTBF  will  be  higher 
because  the  B-IB  is  using  a  similar  computer  and  the  F-15 
program  should  benefit  from  the  testing  done  by  the  B-IB 
program. 
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lOOOC 


Figure  7.  Central  Computer  Model 


10000 


TOTAL  TEST  TIME  (HOURS) 


CHAPTER  6 


F-16  FIGHTING  FALCON 

Background 

The  F-16  was  designed  by  General  Dynamics  as  a 
replacement  for  the  F-4.  The  first  F-16  entered  the  active 
force  in  1979  with  total  procurement  scheduled  to  be  2,165 
aircraft  by  1985.  As  with  the  F-15,  the  current  effort  is  to 
update  the  technology  of  the  avionics  in  the  aircraft. 

Multinational  Staged  Improvement  Program 

The  Air  Force  instituted  a  Multinational  Staged 
Improvement  Program  (MSIP)  on  the  F-16  in  1980.  This  on 
going  program  increases  the  capabilities  of  existing 
avionics  and  makes  provisions  to  accept  future  systems, 
therefore  reducing  retrofit  costs.  The  update  of  the 
existing  equipment  is  being  performed  by  General  Dynamics. 

The  updated  equipment  design  will  have  to  pass  three 
reliability  demonstration  tests  before  being  accepted  by  the 
Air  Force:  a  Development  Reliability  Test  ^DRT) ,  a 
Production  Reliability  Qualification  Test  <PRQT> ,  and  a 
Production  Reliability  Acceptance  Test  (PRAT). 

The  DRT  will  be  performed  on  preproduction  equipment 
and  the  PRQT  will  be  performed  on  production  equipment.  The 
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tests  are  conducted  on  behalf  of  the  government  to 
demonstrate  compliance  with  the  reliability  requirements  as 
a  basis  for  production  approval.  -The  PRAT  is  performed  on 
delivered  production  units  to  determine  compliance  with  the 
reliability  requirements. 

The  reliability  requirements  increase  as  the  design 
goes  through  the  tests.  The  preproducti on  equipment  has  a 
lower  mean-time-between-f ai lure  (MTBF)  requirement  during 
the  Development  Reliability  Test  than  the  production 
equipment  has  during  the  PRDT  and  PRAT.  The  equipment,  the 
required  MTBFs,  and  the  test  type  are  shown  on  Table  4. 

REQUIRED  MTBF 


EQUIPMENT 

DRT 

PRQT  &  PRAT 

TEST  TYPE 

Fire  Control  Computer 

200 

500 

Sequential 

Mul t i -Funct i on  Display 

Set 

95 

320 

II 

Central  Interface  Unit 

85 

250 

•I 

Data  Entry  Electronics 

Unit 

350 

900 

II 

Data  Transfer  Unit 

2000 

4000 

25  hours  of 

failure  free 
operation 


Table  4 

F— 16  MSIP  Reliability  Requirements 

(ASD,  1981b) 

The  Development  Reliability  Test  will  be  conducted 
on  two  pre-product i on  units  of  each  type.  The  Reliability 
Qualification  Test  will  use  five  units  of  the  first  50  units 
delivered  and  the  Production  Acceptance  Test  will  be 
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conducted  on  eight  units  of  the  next  100  produced.  The  Air 
Force  will  randomly  select  the  units  to  be  tested. 

Sequential  tests  may  be  used  to  accept  or  reject 
predetermined  MTBF  values  when  the  total  test  time  is 
relatively  unimportant  (DOD  MIL-STD-781C,  1977).  During  a 
sequential  test  the  cumulative  operating  test  time  is 
plotted  on  a  graph  similar  to  Figure  10.  The  reject  line  and 
the  boundary  line  are  drawn  on  the  graph  prior  to  the  test. 
If  the  plot  crosses  the  reject  line,  the  test  is  stopped, 
and  the  contractor  must  submit  a  corrective  action  plan  and 
incorporate  the  corrective  actions  prior  to  attempting  the 
test  again.  The  corrective  actions  and  the  retest  are  all 
paid  for  by  the  contractor.  If  the  test  is  completed  before 
the  plot  crosses  the  reject  line,  the  equipment  passes  the 
test  and  no  corrective  action  is  required  for  any  failures 
seen . 

A  sequential  test  is  not  performed  on  the  Data 
Transfer  Unit  because  of  the  large  number  of  hours  required 
to  demonstrate  its  high  MTBF  during  such  a  test.  Instead  it 
will  have  to  operate  without  a  failure  for  25  hours  to  pass 
its  reliability  tests.  If  a  failure  occurs,  the  failure 
will  have  to  be  analyzed  and  corrected  before  another  unit 
may  attempt  to  pass  the  test. 

Gary  Arnold,  Reliability  Engineer  for  the  MSIP, 
believes  the  high  cost  of  failing  the  tests  will  cause  the 
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TOTAL  TEST  TIME  (in  multiples  o+*  specified  MTBF) 

(DOD  MIL-STD-731C,  1977,  p.  82) 

Figure  10.  Accept— Reject  Criteria  for 
Sequential  Test 


contractor  to  carefully  design  and  manufacture  the 
equipment,  making  a  reliability  growth  program  unnecessary. 
Also,  since  the  F'RQT  and  the  PRAT  have  higher  MTBF 
requirements  than  the  DRT  (except  for  the  Data  Transfer 
Unit),  the  most  important  failure  modes  found  during  the 
Development  Test  will  be  corrected  by  the  contractor  prior 
to  the  start  of  the  Production  Tests  (Arnold,  1983).  If  the 
correction  of  failures  occurs,  the  result  is  a  reliability 
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growth  program  by  the  contractor. 


Improved  Radar  Reliability  Achi evement_Prpgram 

The  F-16  SPO  is  also  increasing  the  capabilities  of 
the  AN/APG-66  radar  used  on  the  F-16.  The  approach  used  is 
similar  to  that  used  on  the  MSIP  except  a  Reliability  Growth 
Test  is  planned  in  addition  to  the  development  and 
production  reliability  tests.  The  test  requirements  are 
shown  in  Table  5. 


TEST 


NUMBER  OF  REQUIRED 

SYSTEMS  MTBF  (hrs) 


Reliability  Qualification 
Production  Rel  Qualification 
Production  Rel  Acceptance 
Reliability  Growth 


2 

5  of  75 
5  of  200 
7 


25 

35 

35 

750  operating 
test  hours 


Table  5 

F-16  Improved  Radar  Reliability  Requirements 

(Anderson,  1983) 


Westinghouse  predicts  the  slope  of  the  Improved 
Radar  reliability  growth  plot  to  be  0.4.  Since  reliability 
growth  testing  just  started  in  August  1983,  there  is  not 
enough  data  to  compare  to  the  predicted  plot,  but  a  growth 
of  0.4  is  achievable  for  a  radar  system  (Codier,  1968  and 
General  Electric,  1973). 
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CHAPTER  7 


COMPONENT  IMPROVEMENT  PROGRAMS 


This  chapter  describes  the  Component  Improvement 
Programs  -for  the  turbine  engines  used  on  the  F-15,  F-16,  and 
B-1B  aircraft. 


Background 

Engines  developed  -for  new  bombers  and  -fighters 
normal  1 y  use  the  latest  technology  and  can  be  described  as 
being  the  state  o-f  the  art. 

Much  time,  money,  and  ef-fort  is  expended  in  pulling 
together  past  and  present  knowledge  to  produce  an  engine 
with  speci-fied  characteri st i cs.  .  .  .  It  will  contain 

many  compromises  because  it  must  have  many  characteris¬ 
tics,  some  o-f  which  are  diametrically  opposed  to  others 
( ASDP  800-21,  1979,  p.  21). 

When  a  engine  fails  to  meet  a  given  standard,  the 
original  compromises  have  to  be  reevaluated  in  light  of  the 
new  knowledge  available. 

The  Component  Improvement  Program  C (CIP) 3  is  a  con¬ 
tractual  engineering  service,  normally  done  by  the 
original  manufacturer  and  includes  testing,  analysis,  and 
ECP  submittals.  CIP  is  the  vehicle  used  to  transfer 
this  new  knowledge  to  engine  hardware  <ASDP  800-21,  1979, 

pp.  21-22). 

During  development,  new  engines  are  pushed  to  the 
threshold  of  technology  and  hardware  limits.  Sometime  those 
limits  have  been  exceeded  requiring  corrective  actions. 

The  government  should  accept  .  .  .  the  fact  that 
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development  programs  are  risky  at  best,  the  outcome 
cannot  be  accurately  predicted  in  advance,  and  early 
operational  problems  are  to  be  expected  and  overcome 
( ASDP  800-21,  1979,  p.  17). 

According  to  Smith  (1983),  Product  Assurance  .'oca] 
Point  in  the  Propulsion  SPQ,  reliability  growth  of  jet 
engines  is  approached  differently  than  the  improvement  of 
electronics.  Three  factors  explain  the  different  approach: 
availability  of  test  cells,  the  cost  of  testing,  and  aging 
of  equipment. 

Engine  qualification  requires  the  use  of  government 
test  cells  that  can  be  used  to  simulate  various  flight 
conditions.  These  cells  must  have  provisions  for  air  flow, 
altitude  simulation,  and  temperature  variation.  There  are 
only  three  government  facilities  available  for  performing 
tests:  Arnold  Engineering  Development  Center  (AEDC) ,  Naval 
Air  Propulsion  Center  (NAPC) ,  and  NASA/Lewis  Research 
Center . 

The  productivity  of  the  cells  limits  availability. 
Because  of  the  limited  number  of  testing  sites,  various  jet 
engine  development  programs  compete  for  test  cell  time. 
Engines  must  be  scheduled  for  the  cells  months  in  advance. 
Unlike  environmental  chambers  for  electronic  equipment  which 
can  operate  over  100  hours  per  week,  engine  test  cells 
average  only  30  hours  of  operation  (Smith,  1983). 

Cost  is  a  major  factor  in  jet  engine  testing.  Due 
to  the  low  productivity  (which  determines  how  much  overhead 
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is  charged  to  each  test  hour)  and  the  high  energy  costs  to 
operate  the  test  cells,  testing  costs  approximately  *10,000 
per  operating  hour.  Thus,  testing  can  absorb  much  of  the 
budget  for  engine  development. 

Also  unlike  solid  state  electronics,  jet  engine 
parts  age  or  wear  out  during  use.  Testing  is  required  to 
identify  the  point  of  wear  out.  Unf or tunatel y,  many  parts 
do  not  reach  their  wear  out  points  during  the  limited  amount 
of  testing  performed  during  initial  development.  Therefore, 
the  parts  do  not  wear  out  until  after  the  engine  is 
installed  in  an  aircraft  and  flight  testing  takes  place. 

Thus,  a  new  jet  engine  is  not  ready  for  operational 
use  when  it  is  released  for  flight  testing.  In  fact, 
because  of  the  factors  listed  above,  the  engine  may  have 
less  development  testing  than  any  other  piece  of  equipment 
on  the  aircraft.  Often  the  engine  enters  flight  test 
without  demonstration  of  many  of  the  rel i abi 1 i ty/durabi 1 i ty 
requirements.  Knowing  this,  the  Propulsion  SPO  uses 
Component  Improvement  Programs  to  correct  reliability 
deficiencies  and  to  improve  the  engine  above  the 
demonstrated  reliability. 

CIPs  are  used  to  resolve  operational  problems  with 
gas  turbine  engines  in  as  short  a  time  as  possible  after 
development.  The  CIP  begins  with  the  successful  completion 
of  full  scale  engineering  development  and  continues 
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throughout  the  useful  life  of  the  program  (AFR  800-30, 


1980)  . 

AFR  800-30  (1980)  establishes  the  requirement  for  a 
CIP  and  requires  a  program  to  have: 

1.  Accelerated  mission  testing  of  the  production  model. 

« 

2.  Ground  testing  of  production  and  overhauled  engines 
to  allow  comparison  to  base-line  characteri sties. 

The  regulation  goes  on  to  state  that  the  CIP  will: 

1.  Resolve  technical,  operational,  and  support  prob¬ 
lems  discovered  in  use  by  the  user; 

2.  Achive  the  durability  and  reliability  specified  in 
the  contract  .... 

3.  Assess  changes  in  mission  requirements  for  impact 

to  reliability  and  durability  (AFR  800-30,  1980,  p.  3) 

The  regulation  specifically  excludes  actions  that 
improve  the  engine  above  specification  performance  values 
"unless  the  improvement  will  resolve  a  user's  durability  or 
support  problem"  (AFR  800-30,  p.  3).  Additional 
improvements  that  improve  performance  and  durability  above 
specification  values  belong  to  the  Engine  Model  Derivative 
Program  which  is  outside  the  scope  of  this  paper. 

CIPs  are  intended  to  find  problems  to  correct.  Once 
possible  improvements  are  identified  and  evaluated,  ECPs  are 
used  to  implement  proposed  corrective  actions.  CIPs  do  not 
pay  for  the  incorporation  of  fixes  in  the  production  line  or 
into  the  fleet  of  aircraft  in  the  field. 
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EJL9Q_Ergine_CIP 


The  F100  engine,  manufactured  by  Pratt  &  Whitney 
Aircra-ft  (PWA)  ,  powers  both  the  F-15  (F100-PW-100)  and  F-16 
(F100-PW-200)  aircra-ft.  Development  of  the  engine  began  in 
1968,  with  the  -first  -flight  in  a  F-15  in  1972.  The  Component 
Improvement  Program  on  the  FIDO  engine  started  the  following 
year  with  an  *106  million  contract  with  PWA. 

Since  1973  the  Air  Force  has  spent  over  *670  million 
(*  FY82)  on  the  F100  CIP.  While  that  seems  like  a  lot  of 
money,  the  Propulsion  SPO  estimates  the  life  cycle  cost 
savings  from  approved  improvements  to  be  over  *3.6  billion 
<*  FY  82).  The  reliability  improvements  are  included  in  the 
costs  and  benefits  and  are  not  available  separately 
(Furgeson,  1983). 

Several  measures  of  reliability  merit  are  tracked  by 
the  Propulsion  SPO  for  the  FlOO  engine.  They  are: 

1.  Mean  Time  Between  Hardware  Failure  (MTBHF) .  The 
mean  engine  flying  hours  (EFH)  between  hardware  failures. 
Includes  all  unscheduled  maintenance  involving  replace¬ 
ment  or  repair  of  an  engine  part  at  base  level. 

2.  Unscheduled  Engine  Removals  per  1000  EFH. 

Includes  all  base  level  removal  caused  by  engine  hardware 
failures  plus  all  one  time  time-change  Technical  Order 
directed  inspection  removals. 

3.  Class  A  Mishaps  per  100,000  EFH.  Class  A  Mishaps 
are  defined  by  AFR  127.4  Csicl  to  be  those  mishaps  resul¬ 
ting  in  a  total  cost  *500,000  or  more  for  injury,  'cupa- 
tional  illness  and  property  damage;  a  fatality  or  perma¬ 
nent  total  disability;  destruction  of  or  damage  beyond 
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economical  repair  to  an  Air  Force  aircraft. 

4.  Non-Recover able  In-Flight  Shutdown  per  100,000 
EFH.  Includes  all  engine  chargeable  incidents  that 
caused  a  non-pilot  elected  shutdown  of  the  engine  where 
a  restart  was  unsuccessful  (Furgeson,  1983)  . 

Table.6  shows  the  change  in  the  reliability  measures  since 

1981. 


MEASURE  OF  RELIABILITY 

DEC  81 

DEC  82 

JUN  83 

Class  A  Mishaps  per  100,000 

EFH 

(F— 16) 

5.63 

3.65 

2.67 

Unscheduled  Engine 

1  Removals 

per  100,000  EFH 

(F— 15) 

5.36 

4.87 

4.64 

(F— 16) 

4.  17 

4.04 

3.72 

Mean  T i me  Between 

Hardware 

Fai lure 

(F— 15) 

34.6 

37.4 

42.8 

(F— 16) 

38.3 

39.8 

41.5 

Non— Recoverable  In 

-FI i ght 

Shutdown  per  100, 

000 

EFH 

(F— 15) 

10.6 

8.0 

6.2 

Table 

>  6 

Change  in 

FlOO  Engine 

Rel iabi 1 i ty 

Measures 

(Furgeson, 

1983) 

The  reliability  improvement  caused  by  the  CIP  on  the  FlOO 
engine  is  apparent  from  these  numbers. 


Ei01-GErlQ2_CIP 

The  F101— GE— 102  engine,  built  by  General  Electric, 
is  used  in  the  B-1B  bomber.  The  engine  has  a  design  life 
goal  of  10,000  hours  with  parts  exposed  to  the  hot  gas 
stream  in  the  engine  having  a  3,000  hour  design  life  goal 
(Scully,  1983). 

The  CIP  for  the  F101— GE-102  engine  is  planned  to 
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start  in  FYS4  and  is  programmed  over  -four  years.  General 
Electric  has  proposed  spending  4187  million  -for  the  testing 
of  engines  and  the  identification  of  possible  improvements. 
The  tests  will  provide  information  about  the  life  of  engine 
parts,  and  engine  performance,  durability,  reliability,  and 
maintainability.  Of  the  *187  million,  *124  million  is 
proposed  for  life  verification,  durability  improvements 
detected  during  full-scale  development  (FSD) ,  and 
reliability  and  durability  enhancements  (Williams,  1983) 

Funding  constraints  will  limit  GE’s  proposed 
program.  For  example,  GE  proposed  *53  million  for  the  CIP 
in  1984  while  the  Propulsion  SPO  has  budgeted  only  *40 
million.  Negotiations  are  underway  to  redefine  the  CIP  for 
FY84  (Williams,  1983). 

The  CIP  for  the  F101  engine  is  very  similar  to  the 
CIP  for  the  F100  engine.  Costs  should  be  about  the  same  for 
testing  and  engineering,  but  the  savings  on  the  F101  will  be 
lower  because  of  the  smaller  number  of  engines  and  aircraft 
affected  by  the  improvements. 
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CHAPTER  8 


AGM-86B  AIR  LAUNCHED  CRUISE  MISSILE 

fijiEkacoyQd 

The  AGM-86B  Air  Launched  Cruise  Missile  (ALCM)  is  a 
small,  unmanned,  winged  air  vehicle  capable  of  sustained 
flight  following  launch  from  a  carrier  aircraft.  The 
nuclear — armed  missile  is  currently  deployed  with  B-52G 
aircraft  and  may  be  carried  on  B— 52H  and  B— IB  aircraft. 

Development  of  the  AGM-B6B  ALCM  was  started  in  1976 
with  Boeing  Aircraft  Company  (BAC)  as  the  airframe  and 
integration  contractor.  McDonnel 1 -Dougl as  Aerospace  Company 
<MDAC)  provided  the  navigation/guidance  system  and  Williams 
Research  (now  Williams  International)  provided  the 
propulsion  system  as  associate  contractors. 

In  1980  the  AGM-86B  won  a  fly-off  competition 
against  the  AGM-109  designed  by  General  Dynamics.  The 
competition  consisted  of  ten  flights  for  each  missile  and 
several  maintenance  demonstrations. 

Due  to  the  size  and  weight  restrictions  of  the 
missile,  very  little  redundancy  was  built  into  the  on-board 
systems.  Because  of  this,  almost  any  failure  would  result 
in  the  loss  of  the  missile.  Recognizing  the  criticality  of 
failures,  the  designers  planned  for  the  use  of  high 
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reliability  parts  and  severe  qual  if  i  cat  ion  tests  (including 
failure  -free  combined  environment  tests  -for  the  electronic 
and  electro-mechanical  equipment)  to  achieve  a  high  initial 
rel i abi 1 i ty. 

Because  of  the  intense  design  and  demonstration 
testing,  no  formal  reliability  growth  tests  were  planned  for 
the  ALCM.  It  was  thought  that  the  few  improvements  needed 
would  be  highlighted  by  the  flight  test  program. 
Unfortunately  the  system  did  not  perform  as  well  as  expected 
when  flown.  For  example,  the  first  flight  crashed  due  to  a 
software  parameter  value  error. 

The  operation  of  the  missile  during  the  flight  test 
program  did  highlight  errors  that  needed  to  be  corrected 
before  the  missile  could  be  used  as  a  strategic  nuclear 
weapon.  By  June  1983,  seven  out  of  32  test  flights  ended  in 
failure.  Without  a  formal  reliability  growth  program, 
improvements  were  made  using  the  Material  Deficiency 
Reporting  and  Investigating  System  (see  Appendix  A.) 

The  first  service  report  was  received  in  July  1979. 
Since  then,  854  service  reports  have  been  submitted  on  the 
ALCM  and  its  support  equipment.  Of  those,  48  were 
reliability/  maintainability  related  (Fowler,  1983). 

Reliability  growth  of  the  ALCM  was  assumed  from  the 
start.  Changes  were  programmed  for  the  cruise  missile 
program,  based  on  deficiencies  discovered  during  all  phases 


49 


of  -flight  testing.  Thresholds  and  goals  (derived  using 
Duane’s  theoretical  growth  model)  were  established  -for  the 
system  and  were  used  to  monitor  the  progress  of  the 
missile’s  reliability  throughout  its  development  and  initial 
deployment. 

The  1980  Decision  Coordinating  Paper  (DCP)  for 
Milestone  III  (decision  to  enter  production)  set  model 
-mission  reliablity  thresholds  at  the  end  of  the  competitive 
flight  test  program  and  at  the  end  of  development.  A 
reliability  goal  at  maturity  (December  1984)  was  also 
established.  The  model  mission  included  45  days  of  ground 
alert  (attached  to  a  B-52) ,  12  hours  of  being  carried  in 
flight  by  the  B-52  prior  to  launch,  and  then  a  five  hour 
free-f light  to  the  target.  The  DCP  thresholds  and  goals  were: 

Competition  Development  Maturity 
Air  Vehicle  Reliability  0.575  0.86  0.88 

The  Secretary  of  Defense  Decision  Memorandum  (SDDM) 
on  the  ALCM  (1980)  established  a  threshold  and  goal  for  the 
combined  B-52/ALCM  system.  The  SDDM  called  for  the 
reporting  of  the  Alert  Availability  for  the  entire  system  at 
First  Alert  Capability  (Oct  1981),  Initial  Operational 
Capability  (Dec  1982),  and  maturity  (Dec  1984).  The  SDDM 
goals  and  thresholds  were: 

FAC 

Alert  System  Availability  0.87 


IOC  MATURITY 

0.90  0.93 
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Based  on  -flight  tests,  the  air  vehicle  reliability 


was  0.78  at  the  end  o-f  competition,  0.79  at  FAC,  0.80  at 
IOC,  and  0.78  at  the  end  of  development  (Campbell,  1982). 

Due  to  the  small  sample  size  and  low  number  o-f 
flight  tests,  the  apparent  lack  of  growth  since  the  end  of 
competition  cannot  be  confirmed.  Corrective  actions  have 
been  taken  to  remove  failure  modes  and  those  actions  were 
adequate:  no  repeated  failures  occurred.  Unf ortunatel y  new 
failure  modes  appeared  at  the  same  rate  that  the  old  failure 
modes  were  corrected.  As  a  result,  there  was  no  change  in 
the  reliability. 
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CHAPTER  9 


•  SUMMARY  AND  CONCLUSIONS 


Summary 

The  approaches  taken  by  the  system  program  o-f-fices 
to  achieve  reliability  growth  are  varied.  At  one  extreme, 
there  is  a  lack  of  formal  reliability  growth  programs 
(AGM-86B  and  F— 16  MSIP) .  The  expectation  on  those  programs 
was  that  the  design  is  adequate  or  that  improvements  will 
result  from  development  and  production  testing.  A  formal 
reliability  growth  program  was  considered  unnecessary. 

At  the  other  extreme  are  the  planner*  reliability 
growth  tests  as  part  of  the  original  program  (B-1B,  F-16 
Improved  Radar,  and  F-1C  MSIP).  On  those  programs,  the 
approach  was  to  assume  from  the  start  that  the  initial 
rel lability  needed  to  be  improved  to  achieve  its  required 
lev^l . 

In  between  the  two  extremes  is  the  Test,  Analyse, 
and  Fix  test  of  the  B-52  OAS.  There,  a  formal  TAF  test  was 
used  to  improve  the  reliability  after  the  first  production 
units  were  already  built.  The  intent  was  to  reduce  the  risk 
of  having  poor  reliability  and  also  to  lower  life-cycle 
costs. 


It  is  difficult  to  assess  the  success  of  the 
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reliability  growth  programs  because  the  data  to  do  such  an 
analysis  is  seldom  available.  Most  programs  normally  rely 
on  the  field  data  tracking  directed  by  AFR  66-1  <B-52  OAS, 
B-1B,  F-15,  F-16).  Unfortunately,  the  compiled  data  made 
available  by  AFLC  is  not  accurate  and  di scri mi nati ng  enough 
to  assess  the  impact  of  reliability  growth. 

The  programs  that  do  track  improvements  through 
other  means  often  combine  the  results  from  reliability 
oriented  improvements  with  those  from  manuf acturing  and  cost 
savings  programs.  The  total  result  of  all  the  corrections 
is  tracked,  but  after  an  individual  correction  is  made,  the 
separate  tracking  of  its  result  is  lost. 

Q°Q£i.ysi_gns 

There  does  not  seem  to  be  a  con^nsus  on  the  “one 
best  way"  to  achieve  reliability  growth.  The  managers  and 
engineers  of  the  system  program  offices  use  the  methods  that 
are  they  expect  to  work  for  them. 

A  big  question  is:  how  to  know  what  type  of  program 
to  specify?  If  there  has  been  a  growth  program  on  similar 
equipment  by  the  same  contractor,  some  of  the  unknowns  are 
removed.  The  experience  of  either  the  SPO  or  the  Contractor 
can  be  helpful  in  determining  test  length,  sample  size,  and 
other  factors.  Otherwise,  unknowns  about  cost,  schedule, 
and  numbers  of  equipment  to  be  tested  all  can  impact  on  a 
growth  program  usually  by  raising  cost  and  lengthening 
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schedul es. 


The  contractors  are  important  to  a  successful  growth 
program  because  they  do  the  testing  and  assume  some  of  the 
risks.  If  the  contractor  considers  the  risks  to  be  high, 
the  price  of  the  growth  tests  will  increase  considerably, 
but  these  risks  could  be  reduced  if  the  contractor  has  had 
previous  experience  and  the  test  is  fixed  length. 

A  fixed-length  test  removes  the  risk  of  an 
abnormally  long  test  consuming  unplanned  time  and  money. 

For  example,  during  the  sequential  tests  used  on  the  F-16 
MSIP,  the  actual  test  length  could  vary  from  2.8  to  9.74 
times  the  required  MTBFs.  Thus,  during  the  Production 
Reliability  Qualification  Test  on  the  fire  control  computer, 
the  test  time  could  vary  from  1400  to  4870  hours  (DOD 
MIL-STD  781C,  1977).  To  limit  the  risk,  the  contractor 

priced  the  contract  for  the  maximum  test  hours. 

If  neither  the  SPO  nor  the  contractor  has  experience 
to  draw  from,  the  task  of  specifying  the  program 
requirements  will  be  difficult.  For  example,  it  will  be 
necessary  for  the  SPO  to  educate  the  contractors  so  they 
understand  the  requirements  and  the  intent  of  the 
specifications.  Neither  the  SPO  nor  the  contractors  may 
know  how  to  perform  the  five  step  reliability  growth  process 
to  achieve  the  desired  improvements. 

Also,  the  contractors  may  not  know  what  level  of 
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effort  is  required  to  analyze  failures  and  incorporate  the 
necessary  corrective  actions.  In  this  case  it  will  be 
necessary  for  the  SPO  and  the  contractor  to  work  together 
using  the  experimental  knowledge  they  collect  to  adjust  the 
program  as  required.  All  the  uncertainties  create  risks, 
and  the  risks  endanger  a  successful,  on  time  reliability 
growth  program. 

A  meaningful  comparison  of  reliability  growth 
techniques  is  not  possible  based  on  the  data  available  from 
traditional  sources.  Useful  data  is  not  available  to  allow 
comparisons  between  different  programs.  To  gain  the 
necessary  insights,  a  separate,  more  detailed  data  system 
needs  to  be  created. 
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APPENDIX  A 

USAF  MATERIAL  DEFICIENCY  REPORTING  AND  INVESTIGATING  SYSTEM 
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One  way  for  ASD  managers  and  engineers  to  improve 
the  reliability  o-f  existing  equipment  is  to  actively  use  the 
USAF  Material  Deficiency  Reporting  and  Investigating  System 
of  Technical  Manual  TO  00— 35D-54. 

The  Product  Improvement  Policy  (PIP)  for  the  Air 
Force  is  outlined  in  AFR  66-30.  A  PIP  for  a  specific  product 
starts  as  soon  as  possible  after  the  first  item  is  accepted 
by  the  operating  command,  a  production  decision  is  made,  or 
when  operational  test  and  evaluation  (OTfeE)  begins  (AFR 
66-30,  1982,  p.  1). 

An  objective  of  the  policy  is  to  "prevent  the 
recurrence  of  deficiencies  in  design"  in  order  to  improve 
the  cost-effectiveness  and  readiness  of  equipment  in  the  Air 
Force  inventory  (AFR  66-30,  1982,  p.  1).  The  regulation 

outlines  the  following  steps  to  achieve  improvement: 

1.  Review  the  operation  of  equipment  in  the  field  or 
in  0T&E  for  adequate  reliability. 

2.  Analyze  systems  with  marginal  or  unsatisfactory 
performance  to  identify  the  nature  and  cause  of  the 
def i ci ency . 

3.  Identify  possible  corrective  actions. 

4.  Use  the  results  of  the  improvement  efforts  to 
keep  the  deficiencies  from  recurring  in  new  equipment. 

Technical  Manual  TO  00-35D-54  establishes  the  USAF 
Material  Deficiency  Reporting  and  Investigating  System  t>. 
implement  the  Product  Improvement  Policy  of  AFR  66-30.  The 
procedures  of  the  technical  order  apply  to  all  USAF  and  USAF 


supported  agencies. 


The  purpose  of  the  technical  order  is  to 

establish  a  system  that  will  -feed  back  de-ficiency 
data  on  hardware,  computer  programs,  clothing  and  tex¬ 
tiles,  to  activities  responsible  for  development,  pro¬ 
curement,  and  other  logistics  management  functions  so 
that  action  can  be  initiated  to  correct  and  prevent 
maintenance,  material,  design  and  quality  deficiencies 
(TO  00-35D-54,  1982,  p.  1-i). 

Deficiencies  are  reported  to  ASD  program  offices  in 
the  form  of  Service  Reports  (SRs) .  SRs  are  submitted  while  a 
program  office  has  program  management  responsibility  for  a 
system  in  advanced  development,  engineering  development,  or 
operational  use.  Advanced  development  efforts  which  do  not 
procure  or  fabricate  hardware  or  software  or  are  procured 
solely  "to  demonstrate  concept  feasibility  and  substantial 
configuration  changes  are  expected  prior  to  full-scale 
engineering  development  tests"  are  excluded  from  the 
reporting  (TO  00-35D-54,  1982,  p.  5-1). 

According  to  the  technical  order,  five  different 
types  of  deficiencies  can  be  reported: 

1.  Design  Deficiency:  Any  condition  that  limits  or 
prevents  the  use  of  material  for  the  purpose  intended  c- 
required  where  the  material  meets  all  other  specifica¬ 
tions  or  contractual  requirements.  These  deficiencies 
cannot  be  corrected  except  through  a  design  change. 

2.  Maintenance  Deficiency:  A  deficiency  which 
results  in  excessive  maintenance  man-hc  ir  consumption. 

3.  Material  Deficiency:  The  failure  of  an  end  item 
which  was  attributable  to  neither  the  repair  nor  the  man¬ 
ufacturing  process,  but  was  due  to  an  unpredictable 
failure  o+  an  internal  component  or  subassembly. 
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4.  Quality  Deficiency:  A  deficiency  attributable  to 
errors  in  workmanship,  nonconformance  to  speci f i cati ons, 
drawings,  standards  or  other  technical  requirements, 
ommission  of  work  operations  during  manufacture  or 
repair,  failure  to  provide  or  account  for  all  parts, 
improper  adjustment  or  other  condition  that  can  be 
identified  as  nonconformance  to  technical  requirements 
of  a  work  specification. 

5.  Software  Deficiency:  An  error  in  the  statements  or 
instructions  that  comprise  a  computer  program  used  by  an 
imbedded  computer  system.  The  deficiency  may  consist  of 
syntax,  logic,  or  other  di screpanci es  that  cause  the  pro¬ 
gram  to  fail  the  intended  functions  (TO  00-35D-54,  1982, 
p.  1-2.) 

Correction  of  four  of  the  above  types  of 
deficiencies  result  in  improvements  that  can  be  called 
reliability  growth:  design,  material,  quality,  and 
software.  Correction  of  maintenance  deficiencies  does  not 
directly  effect  the  reliability  of  equipment. 

In  addition  to  deficiency  type,  reports  are  also 
classified  by  severity: 

Category  I.  A  deficiency  which  may  cause  death, 
injury  or  severe  occupational  illness;  would  cause  loss 
or  damage  to  a  weapon  system;  or  directly  restricts  the 
combat  readiness  capabilities  of  the  using  organization. 

Category  II.  A  report  of  a  defect  which  results  in  the 
failure  of  or  prevents  the  use  of  an  item,  but  which  does 
not  meet  the  criteria  of  Category  I  (TO  00-35D-54,  1982, 
pp.  1-2  -  1-3) . 

Normally,  Category  I  SRs  must  be  submitted  to  the 
program  offices  within  72  hours  after  finding  the 
discrepancy.  However,  "serious  safety  of  flight  hazards 
will  be  reported  by  telephone  no  later  than  four  hours  after 
discovery".  Category  II  SRs  must  be  submitted  within  15 
calendar  days  after  discovery  (TO  00-35D-54,  1982,  p.  3-1). 


59 


After  receipt,  the  program  office  screens  the  SR  to 
assure  that  it  is  correctly  categorized.  If  the  SR  was 
erroneously  reported,  the  program  office  negotiates  with  the 
originating  activity  be-fore  downgrading  or  returning  the 
report. 

Valid  SRs  are  investigated  as  a  Material  Improvement 
Project  (MIP) .  AFR  66-30  requires  that  a  MIP  be  established 
by  the  command  that  has  program  management  responsibility 
for  the  equipment  in  order  to  track,  control ,  and  document 
the  investigation  and  correction  of  each  deficiency  (AFR 
66-30,  1982). 

An  Air  Force  team  analyzes  the  reported  discrepancy 
and  reports  to  a  MIP  review  board.  The  board,  made  up  of 
representati ves  from  the  program  office,  AFLC,  ATC,  and  the 
operating  command,  acts  as  a  working  group  to  complete  the 
investigation  and  recommend  solutions.  Periodic  reviews  of 
MIPs  are  performed  to  "make  sure  efficient,  timely  and  the 
proper  EsicJ  action  is  taken  to  correct  deficiencies,  and  to 
discontinue  MIPs  of  little  or  no  value"  (AFR  66—30,  1982, 

p.  2)  . 

If  the  MIP  board  recommends  a  design  or  software 
change  as  a  corrective  action,  the  program  office  works  with 
the  contractor  to  make  the  change.  Design  or  software 
corrections  are  usually  handled  through  ECPs. 

The  SR/MIP  process  is  a  valuable  tool  to  get 
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improvements  resulting  in  reliability  growth  especially  if 
there  is  no  other  formal  program  to  seek  reliability  growth 


(as  with  the  AGM-86B  ALCM) . 


SELECTED  BIBLIOGRAPHY 


A.  REFERENCES  CITED 


Anderson,  Jeffery.  Reliablity  Engineer,  Directorate  for  the 
F— 16,  HQ  Aeronautical  Systems  Division,  Wr i ght-Patterson 
AFB  OH.  Personal  interview.  S  August  1933. 

Anderson,  R.G.  "The  Potential  Use  of  Reliability  Growth 
Curves  in  Management  of  Weapon  Systems."  Unpublished 
master’s  thesis.  Naval  Postgraduate  School  CA, 

September  1976.  AD  A039351. 

Aeronautical  Systems  Division,  Air  Force  Systems  Command. 
B-1B  System  Specification  SS2569A01A.  Wri ght-Patterson 
AFB  OH,  23  November  1981a. 

_ .  Contract  F33657-80-C-0174  with  Boeing  Military 

Airplane  Company.  Wri ght-Patterson  AFB  OH.  2  February 
1978. 

_ .  F-16  Air  Vehicle  Specification  16PS058A. 

Wri ght-Patterson  AFB  OH,  6  August  1981b. 

_ .  Handbook  For  Engine  Component  Improvement  Program 

Managers.  Pamphlet  800-21.  Wri ght-Patterson  AFB  OH,  5 
January  1979. 

Boeing  Military  Airplane  Company.  B— 52_0AS_Test_Anaiyze_and 
Fi x  Fi^nal _Repgrti_Vgl _1 .  Boeing  Document  D675- 15539-2, 
Wichita  KS,  16  December  1982. 

Campbell,  Captain  Clinton  L. ,  USAF.  Personal  Notes.  1982. 

Codier,  E.O.  Reliability  Growth  in  Real  Life.  In  Proceedings 
of  the  Annual  Reliability  and  Maintainability  Symposium, 
Institute  of  Electrical  and  Electronics  Engineers,  New 
York,  1968. 

Directorate  for  the  B-1B,  HQ  Aeronautical  Systems  Division, 
AFSC.  System_Sgecif  icat  i_on_f  gr_the_B-XB_Weagon_System, 
Specification  No.  SS2569A01A.  Wri ght-Patterson  AFB  OH, 

23  November  1981. 

Directorate  for  Tactical  Systems,  HQ  Aeronautical  Systems 
Division,  AFSC.  MSXP_Phase_I,I_Statement_gf  _Wgr  k . 

Revision  A.  to  memo  210-F15-8353,  Wri ght-Patterson  AFB 
OH,  undated. 


63 


Duane,  J.T.  Iechnical_,In£grmatign_Seri.es_ReEgrt_DF62MI)300. 
General  Electric  Company,  DCM+G  Department,  Erie  PA, 
1962. 

Edwards,  Jerry.  Reliability  Engineer,  Directorate  -for 
Tactical  Systems,  HQ  ASD,  Wri ght-Patterson  AFB  OH. 
Personal  interview.  12  August  1983. 

Fowler,  Master  Sergeant  Ronny  W. ,  USAF.  Service  Report 
Manager,  Directorate  fdr  Strategic  Systems,  HQ  ASD, 

Wri ght-Patterson  AFB  OH.  Personal  interviews.  11,13, 

and  15  July  1983. 

*  « 

Furgeson,  First  Lieutenant  Lawrence,  USAF.  Manager,  FlOO 
Engine  Component  Improvement  Program,  Directorate  -for 
Propulsion,  HQ  ASD,  Wri ght-Patterson  AFB  OH.  Personal 
interviews.  18  and  28  July  1983. 

General  Electric  Company.  Research_Study_g£ _Radar 

Rel.i_abi.l_i  ty_and_Its_lmgact_gn_Li.£e-Cycfe_Cgsts_£gr_the 
APQ— f 1. 4X_— f 20_and_— f 44_Radar s .  Technical  Report, 
ASD  TR-73-22,  Wr i ght-Patterson  AFB  OH.  April  1973. 

Harmsworth,  Sharon.  L.  Reliability  Engineer,  Directorate  for 
Tactical  Systems,  HQ  ASD,  Wright— Patterson  AFB  OH. 
Personal  interviews.  20  July  and  15  August  1983. 

Illinois  Institute  o-f  Technology  Research  Institute. 

Reliability  Design  Handbook  (RDH  376) .  Chicago  IL,  1975. 

Roadruck,  Major  Max  J.  Jr.,  USAF.  Manager,  F-15  Multi-Staged 
Improvement  Program,  Directorate  for  Tactical  Systems, 

HQ  ASD,  Wri ght-Patterson  AFB  OH.  Personal  Interview.  21 
July  1983. 

Scully,  First  Lieutenant  Sean  P. ,  USAF.  Test  Manager  F101 
Engine,  Directorate  for  Propulsion,  HQ  ASD, 

Wright— Patterson  AFB  OH,  Personal  interviews.  15  July 
1983. 


Slenski.  First  Lieutenant  Mary  L. ,  USAF.  Acting  Lead 

Engineer  for  Product  Assurance,  Directorate  for  B-1B,  HQ 
ASD,  Wright— Patterson  AFB  OH,  Personal  interviews.  1 
and  5  July  1983. 

Smith,  Robert  E.  Lead  Engineer  for  Product  Assurance, 

Directorate  for  Propulsion,  HQ  ASD,  Wright-Patterson  AFB 
OH,  Personal  interview.  15  July  1983. 


64 


Swett,  Colonel  Benjamin,  USAF.  "The  Challenge  of  Reliability 
Growth, “  Journal  of  Environmental  Sciences. 
January-February  1979,  pp  74-78. 

The  Analytic  Sciences  Corporation  (TASC)  .  Of  f  ensi ye_Ayigni.cs 
System_Test— Anal_y2  e3Fi.x_Rel.iab  i^i_ty_2mgrgyement_Pr  ogram. 
TASC  Document  TR— 3406— 3,  Reading  MA,  22  February  1983. 

U.S.  Department  of  the  Air  Force.  Prgduct_Imgrgvement_Pgl.i.cy 
lPiPi_£or_Ogeratignal_Egui.Bment .  AFR  66-30.  Washington: 
Government  Printing  Office,  8  February  1982. 

_ .  Ai  r_Fgrce_Reiiabiiity_and_Mai_ntai  nabiiity_Program. 

AFR  800—18.  Washington:  Government  Printing  Office,  15 
June  1982. 

_ •  Li fe_Cycl e_Management_of _ Aeronaut ^c§i_Gas_ Turbine 

Engines.  AFR  800-30.  Washington:  Government  Printing 
Office,  14  April  1980. 

_ .  y§AF_Materiai_Def iciency_Regorting_and 

Investigating  System.  Technical  Manual  TO  00-35D-54. 
Washington:  Government  Printing  Office,  1  February  1981. 

U.S.  Department  of  Defense.  Decision  Coordinating  Paper  for 
the  AGM— 86B  Air  Launched  Cruise  Missile  Number  136.  3 
March  1980. 

_ .  Reiiabiiity_and_Maintainabiiity.  D0D  Directive 

5000.40.  Washington:  Government  Printing  Office,  1980. 

_ .  Xest_and_Eyal.uati.gn_gf_System_Rel.iabiii.tyi. 

Avai lability.  Maintainabi 1 i ty  -  ft  Primer.  DOD  3235. 1-H. 
Washington:  Government  Printing  Office,  1982. 

_ -  Reliabiiity_Growth_Management .  Military  Handbook 

189.  Washington:  Government  Printing  Office,  February 
1981. 


_ .  Eiectrgnic_Reiiabiiity_Design_Handbggk.  Military 

Handbook  XXX  (Draft).  Washington:  Government  Printing 
Office,  December  1982. 

_ •  Rel  iabiiity_Design_Qual  if  ic  at  ign_and_Pr  oduc  t  i.gn 

^£ceBtance_Xestsi_Exggnent ial _Distr ibut ion .  Military 
Standard  781C.  Washington:  Government  Printing  Office, 
1977. 

- •  Befi abil ity_Prggram_f gr_Systems_and_EguiBment 

Devef QEment_and_Prgduct ion .  Military  Standard  785B. 


65 


Washington:  Government  Printing  Office,  1980. 

_ .  Secretary  of  Defense  Decision  Memorandum  on  the 

Air  Launched  Cruise  Missile,  DSARC  III.  30  April  1980. 

Williams,  Don  S.  Deputy  Director,  Strategic  Engines  Program 
Office,  Directorate  for  Propulsion,  HQ  ASD, 

Wright— Patterson  AFB  OH.  Personal  interview.  15  July 
1983. 


B.  RELATED  SOURCES 


U.S.  Department  of  Defense.  Rel_i.abi^i.ty_Grgwth_Test i.ng. 
Military  Standard  16351EC).  Washington:  Government 
Printing  Office,  1978. 


66 


